Organization of Complex Networks without Multiple Connections 
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(Dated:) 

We find a new structural feature of equilibrium complex random networks without multiple and 
self-connections. We show that if the number of connections is sufficiently high, these networks 
contain a core of highly interconnected vertices. The number of vertices in this core varies in the 
range between const N 1 ^ 2 and const N 2 ^ 3 , where N is the number of vertices in a network. At the 
birth point of the core, we obtain the size-dependent cut-off of the distribution of the number of 
connections and find that its position differs from earlier estimates. 
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Introduction. — Real-world networks are based on more 
complex architectures than the classical random graphs 
which have the "trivial" Poisson distribution of connec- 
tions P, • In this sense, the real networks are complex. 
Equilibrium models 0- El 0- Q provide one with a conve- 
nient tool for studying the architectures of the complex 
networks. The problem of the structural organization of 
an equilibrium random graph without multiple connec- 
tions is among the basic problems of the statistical me- 
chanics of networks. The point is that the theory of an 
equilibrium random network with multiple connections 
[IJ can be reduced to the basic non-network problem 
of the distribution of balls among boxes — "the balls- 
in-boxes model" or, as it is also called, the backgam- 
mon model [?]. In contrast, the problem of the net- 
work without multiple connections is irreducible to sim- 
ple non-network problems. The difficulty is that the in- 
troduced constraint complicates the calculation of the 
partition function of the statistical ensemble of networks. 
Furthermore, the strong difference from the multiple- 
connection case can be found only for size-dependent 
quantities, which demands heavy analytical work, while 
intuitive arguments are unreliable. Due to these diffi- 
culties, the problem remained unsolved up to now. To 
describe the structure of the network without multiple 
connections, intuitive arguments Q and simulations 
were used. Also, the generation of degree-degree cor- 
relations in simple models of networks of this kind was 
studied 0, 0, 0] (degree is the number of connections 
of a vertex). 

In the present Letter, we report the solution of this 
long-standing problem. In our study we use a general 
basic construction of equilibrium networks. In the frame- 
work of a strict statistical mechanics approach, we de- 
scribe the equilibrium ensemble of networks without mul- 
tiple connections where vertices are statistically indepen- 
dent. We find that the complex architectures of these 
networks markedly differ from those for networks with 
multiple connections. We show that at sufficiently high 
densities of connections — above a critical value, the net- 
works contain a compact core of Nh(N), const N 1 / 2 < 
Nh{N) < const A 2 / 3 , highly interconnected vertices [see 



Fig-fflj where A is the number of vertices in a network. In 
particular, in the networks with slowly decreasing degree 
distributions, Nh ~ A 2 / 3 . This core is a previously un- 
known detail of the structure of complex networks. We 
find the form of the degree distribution at the critical 
point and obtain the position of its size-dependent cut- 
off. In this Letter we present and explain our results 
and outline the derivation. The detailed solution will be 
published elsewhere. 

The ensembles. — Following graph theory, we use the 
standard terms "multiple graphs" and "simple graphs" 
for the graphs with and without multiple edges and loops 
of length 1, respectively 0. The equivalent terms are 
non-Mayer and Mayer graphs, respectively Q. The term 
"random graph" means a statistical ensemble of graphs: 
a set of graphs with their statistical weights. Each graph 
g, a member of a statistical ensemble Q, is described by 
its adjacency matrix with elements gij. In simple graphs, 
gu = and gtj = 0, 1 for i ^ j, while in multiple graphs, 
gu = 0, 2,4, . . . and g^ = 0, 1, 2, . . . for i ^ j. The vertex 
degree is = J2f=i 9ij ( m our ensembles all graphs have 
equal numbers of vertices, A). For brevity, we consider 
sparse networks, where the mean degree is finite in the 
limit of large A [Tj . 




=N 



FIG. 1: Schematic view of the structure of a network with- 
out multiple connections if its vertex mean degree exceeds a 
critical value. The size Nh(N) of the compact core varies in 
the range between const N 1 ^ 2 and const 7V 2//3 vertices. The 
rest, less connected vertices are shown by a bubble. The num- 
ber of interconnections in the core (as well as the number of 
outgoing edges) is a finite fraction of all edges. In a similar 
situation, in the multiple network, a finite fraction of all edges 
are attached to a single hub with numerous loops of length 1. 
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In our approach, a random network is a final station- 
ary state of an evolving ensemble. The evolution of the 
ensemble (i.e., transitions between its members — graphs) 
is due to the processes of reconnection/addition/removal 
edges (see below). These processes are governed, e.g., by 
rules of preferential linking , where vertices for linking 
are selected with probabilities proportional to a function 
of their degrees — a preference function f{q). The result- 
ing network architectures are essentially determined by 
the form of this function. For a wide variety of the pref- 
erence functions, these equilibrium networks look as fol- 
lows, (i) If the mean degree q is below a critical value q c , 
the degree distribution H(q) is a rapidly decreasing func- 
tion, (ii) At the critical point, the degree distribution 
decreases slower than an exponential function, (iii) For 
q > q c , the degree distribution actually coincides with 
the critical one plus the edge condensation occurs (in 
multiple graphs) or the core emerges (in simple graphs). 

The members of the grand canonical ensemble of net- 
works with statistically independent vertices are all pos- 
sible graphs (with a given number of vertices) taken with 
the following statistical weights 0, : 

where the parameter A controls the state of the ensemble 
and is related to the chemical potential (and the fugac- 
ity) of edges, L(g) = \ £\ j 9ij = § 2j 2i is tne number 

of edges in a graph g, and p(q) = Hr=o f( r )- The term 
"statistically independent vertices" indicates the specific 
factorized form of statistical weights (JJJ. These weights 
are the final result of the following assumed network evo- 
lution. Two processes take place with equal rates: (i) 
randomly chosen edges disappear and (ii) new edges con- 
nect vertices selected with probability proportional to 
the product f(qi)f(qj) of the preferential functions of 
their degrees. We introduce II c (g) = p(q)/q\, which has 
a meaning of the degree distribution of the infinite net- 
work at the critical point (see below), and its Z-transform 
= J2^Lo ^c{q)x q . Note that this and the next for- 
mulas for statistical weights of ensembles are valid both 
for simple and multiple graphs. The partition function 
Zee of the grand canonical ensemble is the sum of the 
statistical weights Q over all possible graphs with a 
given number of vertices. 

The members of the canonical ensemble of networks 
with statistically independent vertices are all possible 
graphs with a given number L of edges (and a given num- 
ber of vertices), Qc- (Note that Qc is a finite set.) Their 
statistical weights are 

These weights are the final result of the following evolu- 
tion process: (i) randomly chosen edges disappear and 



simultaneously (ii) a new edge connects two vertices 
selected with probability proportional to the product 
f(qi)f{qj) of the preferential functions of their degrees. 
The partition function Zc of the canonical ensemble is 
the sum of the statistical weights over graphs belong- 
ing to Qc- The partition functions of the ensembles are 
related to each other: 

Z C (N, L, { P (q)}) = j> ^X^ZadN, A, {p(q)}) . (3) 

We have obtained the leading asymptotics of the parti- 
tion function of the canonical ensemble of large simple 
graphs in a compact form. The analysis of this function 
readily leads to the following results. 

Results. — We have found that if the mean degree q 
exceeds a critical value q c — J2^Lo Q^c(q), the highly 
interconnected core emerges in the simple graph. This 
core contains 

N h = N{q - q c )/Q{q) ~ N 2 ' 3 In^N (4) 

vertices with a typical degree Q ~ N 1 / 3 ln 1 / 3 ^, if f(q) 
is such that H c {q) decreases with q slower than any 
stretched exponential function. Formula (jJJ is valid if 
Nh is large enough. A finite fraction of the total number 
of edges in the network turns out to be inside of the core. 
Also, a finite fraction of all edges connect the core ver- 
tices to the rest weakly connected vertices. In contrast, 
in multiple networks with q > q c , N(q — q c ) edges are con- 
nected to a single hub — condensed on it quite similarly 
to condensation in the backgammon model 0. A finite 
fraction of these edges form numerous loops of length 1. 

The presence of the core is indicated by the form of 
the resulting degree distribution. At q < q Cl the degree 
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FIG. 2: Schematic plots of the resulting degree distributions 
of the equilibrium networks without (a) and with (b) multiple 
connections in a phase where the mean degree q exceeds the 
critical value q c . In simple terms, the degree distributions con- 
tain two contributions. The first one coincides with the degree 
distribution at the critical point, q c . The second contribution 
is a peak due to the highly interconnected core vertices of a 
typical degree Q ~ N/Nh(N) in the simple network (a) or a 
peak due to a single vertex attracting a finite fraction of all 
connections in the multiple network (b). L cx = N(q — q c ). 
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distributions are (exponentially) rapidly decreasing for 
any preference function 0, , and we do not discuss this 
uninteresting range. In contrast, at q > q c , the degree 
distributions have a complex form. In particular, if II c (g) 
decreases slower than any stretched exponential depen- 
dence, the degree distribution of a simple graph is 



11(g) = Il c ( q )B 



(q/Q)-3(i/Qf 
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where the characteristic degree Q — Q(q, N) is 



\q-qc 



lll< 



(Nf) 



2\2/3 



(q -9c) 5 / 3 



n, 



Nq 2 



1/3- 



(5) 



(6) 



1/3 



(7) 

Formula JSJl is valid above q c in the range of parame- 
ters where the arguments of the logarithm and LT C in 
relation J7J are much greater than 1. We find that 
Q ~ iV 1 / 3 In 1 ' 3 N and so B in formula © is a (positive) 
power of N. This results in a narrow peak of relative 
width Sq/Q ~ l/\nN -C 1. The resulting degree dis- 
tribution (J3J) is schematically shown in Fig. Ufa). The 
presence of the peak around Q, where the area under 
the peak is N^/N, indicates that in the simple networks, 
there is a core of Nh highly interconnected vertices. 

For comparison, we obtained the degree distribution 
of the multiple network above q c . This distribution is 
schematically shown in Fig. |2Jb). The distribution con- 
tains the (1 — 1/N) contribution of normal vertices and 
a narrow peak of weight 1/N at the degree 2L 0X = 
2N(q — q c ), which corresponds to the condensation of 
the corresponding finite fraction of edges on a single ver- 
tex. L cx is the number of excess edges compared to the 
number of edges at the critical point q c . 

The form of the degree distributions depends on details 
of the preference function. In particular, if /(g) = q + 
1 — 7 as q — > oo, the critical state degree distribution 
is power-law, IT c (g) ~ g~ 7 , i.e., with divergent higher 
moments. If /(g) grows slower, then all the moments of 
the critical degree distribution converge. At the critical 
point q — q c , the degree distribution of the network is 
equal to H c (q) modified by finite-size effects. At this 
point, in the simple graphs with with a convergent second 
moment m 2c = J2 q q 2 H c (q) < oo, 



n(g,iV) =n c (g)exp 



1 



1 



2N \m 2c - ql 



m 2l 



(8) 



At the same point, in the simple networks with power- 
law II c (g) = Ag -7 , 2 < 7 < 3, which corresponds to 
m,2c = oo, we find 



n(g,jV) = II c ( g )exp< 



2 N 



2/(5-7) 



(9) 



Relations iJSJ and © demonstrate a Gaussian size- 
dependent cutoff of the degree distribution. If m 2c < oo 
(in particular, if in a scale- free network 7 > 3), then the 
cutoff degree is g cu t ~ N 1 / 2 . This square-root law fails if 
77i2 C = 00, i.e., in particular, when exponent 2 < 7 < 3. 
In the simple networks with a power-law II c (g), we have 



g cut (A0~A^ 2 



if 7 >3, 



gcut 



(N) ~ TV 1 ^ 5-7 ) if 2< 7 <3. 



(10) 



We emphasize the difference from the multiple networks, 
where the cutoff degree is g C ut ~ N 1 / 2 for both the con- 
vergent and divergent m 2c . 

We also described the core in networks with a stretched 
exponential degree distribution ~ exp(— const q a ), < 
a < 1, which are generated by using the preference func- 
tion /(g) = g-constg". In this case, N h cx N ( - 2 ~ a ^ < - 3 ~ a \ 
i.e., the exponent of Nh(N) is in the range (1/2,2/3). 

Outline of derivations. — It turns out that the grand 
canonical ensemble exists only for networks with ex- 
tremely rapidly decreasing degree distributions. Conse- 
quently, we must find the partition function of the canon- 
ical ensemble. However, as is usual, it is the grand canon- 
ical ensemble that admits a convenient analytical consid- 
eration. So, first we derive the partition function of the 
grand canonical ensemble of simple graphs and then, by 
substituting this result into relation J3J), obtain the par- 
tition function of the canonical ensemble. 

For our purposes, it is convenient to use the in- 
verse Laplace transform of the $(x) function: ^(z) — 
f-i^ e ~ zx ®( x )dx/(2iri), which, at large z, coincides with 
H c (z)e~ z if II c (z) decays slowly enough. In terms of this 
function, the partition function of the canonical ensem- 
bles both of the simple and multiple graphs is 

r N 

Z GC (N,X) = / d A, zJ]vi/( Zl )exp[/ J v(A,z)]. (11) 
•* »=i 

For the multiple graph ensemble, /jv(A, z) = 
Ylij=i ZiZj/(2NX). For the ensemble of simple graphs, 
we use the following idea — the key point of this Letter. 
We substitute the exact function 



1 N 

MA,z) = - ]T ln(l 



~N\J 



(12) 



by the asymptotically exact one: 
2 ^A Zl ) ~ 2NX ^ ** ~ WW (§ **) ' (13) 



vi=l 



i=l 



which allows a convenient analytical consideration. The 
reasons to truncate the expansion are as follows: (i) The 
contributions of simple graphs remain unchanged, (ii) 
The contributions of graphs with single 1-loops on ver- 
tices remain zero [note m formula (|12fl ]. (iii) The 
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contributions of graphs with double edge connections re- 
main zero, (iv) Graphs with multiple 1-loops on a vertex 
and graphs with triple, quadruple, etc. connections still 
contribute to the partition function. However, this con- 
tribution is negligible. Indeed, the contribution of any 
subsequent term in expansion (|13|1 to the partition func- 
tion Z may be estimated as Zq /N times the contribution 
of the preceding term. Here, zq is the characteristic value 
of the integration variables z%\ zq ~ 1 in the "normal" 
phase, and Zq ~ Q ~ TV 1 / 3 in the phase with the core. 

Using the function l|13fl allows us to arrive at the fol- 
lowing asymptotic form of the partition function: 



Zgc(N,X) = 




xe -(NX^2) + [ NXy-lf/i qN^ y) ^ (w) 

where 

/oo 
dze xz - yz2/2 V{z). (15) 
-oo 

After substitution of expression l|14|l into relation © , the 
partition function of the canonical ensemble at large N is 
calculated by using the saddle point approximation with 
respect to all three integration variables. Finally, using 
the relation 11(g) = N~ 1 SlnZ c (N, L)/ Sin U c (q) leads to 
the degree distribution. 

Interpretation. — Let us compare our result for the size 
of the core with characteristic size scales of highly con- 
nected graphs with ~ N edges. These networks have two 
characteristic sizes: (i) A fully connected simple graph 
consists of Nf(N) ~ TV 1 / 2 vertices, (ii) A multiple ran- 
dom graph with, on average, one double connection per 
vertex consists of Ni(N) ~ TV 2 / 3 vertices. Indeed, the 
typical degree of a vertex in this network is Q ~ N/N\. 
The probability that a vertex has one double edge must 
be compared to 1, i.e., {Q/N)Q 2 ~ 1. Here Q/N is 
the probability that a given pair of edges of a vertex 
forms a double connections. This probability is multi- 
plied by the total number of edge pairs of the vertex, 
Q(Q - l)/2 ~ Q 2 . So, N 2 /Nl ~ 1 and Nj. ~ A^ 2/3 . 

Thus, in the networks with slowly decreasing degree 
distributions, the core is far less densely interconnected 



than the corresponding fully connected graph. Its size 
Nh(N) and structure are close to those of the multiple 
random graph with one double connection per vertex. In 
networks with a stretched exponential degree distribu- 
tion, the core is more dense, with Nh(N) in the range 
between those two scales — N 1 / 2 and TV 2 / 3 . 

Discussion and conclusions. — A few points should be 
emphasized. 

(i) We considered homogeneous networks. Condensa- 
tion of edges in inhomogeneous networks, e.g., in net- 
works where the preference function depends on individ- 
ual properties of vertices and not only on degree, is a 
different problem [lq . 

(ii) The cutoff degree - N 1 ^ 5 "^ found at 2 < 7 < 3 
differs from the earlier estimate N 1 ^ 2 which was sup- 
ported by heuristic arguments One may show, how- 
ever, that it was actually an upper estimate. 

(iii) An empirical researcher usually studies a random 
network by using only one member of a statistical ensem- 
ble. Therefore, he cannot observe the high degree part 
of the degree distribution, where, in total, less than one 
vertex occurs. For a power-law degree distribution this 
condition leads to an upper observable degree ~ TV 1 / (t -1 ) 
[l7j . This restriction is irrelevant at 2 < 7 < 3, where the 
cutoff degree ~ N 1 ^ 5 "^ JTHJ) is smaller than N 1 /^^. 
However, it hinders the observation of the N 1 / 2 cutoff at 
7 > 3, where TV 1 /^" 1 ) is smaller than N 1 / 2 HQ. 

(iv) In our networks, we implemented processes includ- 
ing preferential linking, but it is not a limiting factor. 
Our general results could be equally obtained by using 
network constructions without preferential attachment 
|3T,l4lll8l|. where the condensation of edges also occurs. 

In summary, we have described the organization of 
random networks without multiple connections. A new 
structural feature of complex networks — a highly inter- 
connected compact core — has been revealed. The pro- 
posed strict statistical mechanics approach may be gen- 
eralized to networks with various correlations. 
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